Greedy Random Walk 



Tal Orenshtein 



Igor Shinkar < 



Abstract 



We study a discrete time self interacting random process on graphs, which we 
call Greedy Random Walk. The walker is located initially at some vertex. As time 
evolves, each vertex maintains the set of adjacent edges touching it that have not 
been crossed yet by the walker. At each step, the walker being at some vertex, picks 
an adjacent edge among the edges that have not traversed thus far according to 
some (deterministic or randomized) rule. If all the adjacent edges have already been 
traversed, then an adjacent edge is chosen uniformly at random. After picking an 
edge the walk jumps along it to the neighboring vertex. We show that the expected 
edge cover time of the greedy random walk is linear in the number of edges for 
certain natural families of graphs. Examples of such graphs include the complete 
graph, even degree expanders of logarithmic girth, and the hypercube graph. We 
also show that GRW is transient in 7L d for all d > 3. 



Greedy Random Walk (GRW) on a graph is a discrete time random process, with 
transition law defined as follows. The walker is located initially at some vertex 
of the graph. As time evolves each vertex in the graph maintains the set of all 
adjacent edges that the walker has not crossed yet. At each step the walker picks an 
unvisited edge among the edges adjacent to its current location arbitrarily according 
to some rule. If all the adjacent edges have already been visited, an adjacent edge 
is picked uniformly at random. The walker, then, jumps to a neighboring vertex 
along the chosen edge. We think of the process as trying to cover the graph as 
fast as possible by using a greedy rule that prefers to walk along an unvisited edge 
whenever possible. This suggests the name Greedy Random Walk. 

Formally, for an undirected graph G = (V, E) a GRW with a (possibly random- 
ized) rule 1Z on G is a sequence Xq,X\, X2, ... of random variables defined on V 
with the following transition probabilities. For each t > define 



to be the set of all the edges traversed by the walk up to time t. For every vertex 
v £ V and time t > define 
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1 Introduction 




(i) 




(2) 



to be the set of all the edges touching v that have not been traversed by the walk 
up to time t. Denoting by N v is the set of neighbors of v in G, the transition 
probabilities are given by: 



Pr[X m =w\(Xi) 



i<t\ 



{ KiwKXi)^) J t (X t ) ± and {X t , w} G J t (X t ] 
j t (x t ) = and w G N Xt 
otherwise , 



where lZ(w\(Xi)i<t) denotes the probability of choosing w G Nx t conditioned on the 
information regarding the process so far. A natural rule 1Z is to choose uniformly 
at random an edge among the adjacent unvisited edges Jt(v) of the current vertex 
v = X t . We shall denote this rule by 7£rand- 

One can think of GRW as a random walk where the walker wishes to cover 
the graph as fast as possible and is allowed to make some local computation at 
each vertex she visits (e.g., mark the last edge that the walker used to reach the 
current vertex, and also mark the edge that the walker is going to use in the next 
step), but is not allowed to transfer information between vertices. A motivation 
for the study of GRW arises from distributed computation in which an agent sits 
on every vertex of a graph. Each agent has a list of neighbors and is allowed to 
communicate only with them. The goal is to let all the agents use some resource as 
fast as possible, while using only the local information for each vertex, and no extra 
information regarding the graph and the vertices that have already been visited. 
An agent has a list of neighbors who communicated with him thus far during the 
process, and each time the agent receives the resource, she is allowed to perform 
only local computations before moving it to one of her neighbors. We will see 
that the GRW protocol performs better than simple random walk (SRW) on some 
families of graphs. 

The main difficulty in analyzing such random process comes from the fact that 
GRW is self- interacting, i.e., is not a Markov chain (meaning that the probability 
distribution of the next step depends not only on the current position of the walker, 
but also on the entire walk thus far). Although in many cases a certain property 
of self interacting random walks can be observed in simulations or seems to be 
suggested by "heuristical proof" , typically it is much harder to give robust proofs for 
random walks that do not have the Markov property. Related models include RW 
with choice [5] non-backtracking RW [4], RW with neighborhood exploration [8], 
excited RW [7] reinforced RW [IT], rotor router RW [2], and more. Recently this 
model has been considered independently by Berenbrink et al. [9]. They showed 
that if G is an even degree expander graph such that every vertex is contained in a 
vertex-induced cycle of logarithmic length, then the expected vertex cover time by 
GRW is linear for any rule 1Z. 



1.1 Our Results 

In Section [2] we study the edge cover time of GRW on finite graphs. Obviously, 
the edge cover time of any graph G = (V,E) is at least \E\, as the walker must 
cross every edge at least once. We prove bounds on the edge cover time of GRW 
by analyzing the "overhead" of the walk, i.e., the difference between the expected 
edge cover time of the walk, and the number of edges in a graph. For example, we 
establish that the expected time it takes for GRW to go via all edges of K n , the 
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complete graph on n vertices is Q) + (1 + o(l))nlog(n). Therefore, the aforemen- 
tioned "overhead" in the case of K n is (1 + o(l))ralog(ra). In particular, all edges of 
K n are covered by GRW in time is (1 + o(l)) • (2), which is asymptotically faster 
than 6(n 2 logn), the expected edge cover time of SRW. 

We show that for certain families of graphs the expected edge cover time of GRW 
is asymptotically faster than that of SRW. In particular, we establish that expected 
edge cover time of GRW is linear in the number of edges for the complete graph, 
for the hypercube graph, and for constant even degree expanders with logarithmic 
girth. The later result is claimed in the paper of Berenbrink et al. [9j without proof. 

Another interesting result is given in Lemma 12.101 that bounds the edge cover 
time of an even degree graph by GRW in terms of its vertex cover time by SRW. 
Specifically, we show that for any graph G = (V, E) whose vertices have even 
degrees, and its expected vertex cover time by SRW is C it holds that the expected 
edge cover time of G using GRW is at most \E\ + C. Therefore, for even degree 
graphs of logarithmic degree, whose vertex cover time is 0(nlog(n)) we obtain a 
bound on the edge cover time which is linear in the number of edges. 

These result should be compared with the general lower bound on the expected 
cover time of graphs by SRW. Recall that Feige has shown that for any graph 
with n vertices the expected vertex cover time by a simple random walk is at least 
(1 — o(l))nlogn. Analogously, for all graphs the expected edge cover cover is at 
least Q(|i£| log ( I I ) ) (see [20J, [lj). In this direction, a result of Benjamini, Gurel- 
Gurevich and Morris [6] says that for bounded degree graphs linear cover time is 
exponentially unlikely. 

We are also interested in the behavior of GRW on infinite graphs. It is well 
known that SRW on Z d is transient if d > 3, and recurrent otherwise. We prove that 
GRW is transient on Z d for d > 3. The case of d = 2 remains open, and it is shown 
to be equivalent the notorious two dimensional mirror model problem [18|ll2j. Our 
proof holds for all graphs with even degrees on which SRW is transient. This leaves 
unsolved the question of transience of GRW in latices with odd degrees. These and 
other related results are discussed in Section O which can be read independently 
of the rest of the paper. 

General remarks: 

The choice of the rule 1Z: In the first version of this paper we considered GRW 
that uses only the rule 7£rand- After the first version of our work was uploaded 
to arxiv . org, Berenbrink et al. [S] independently published their work in 
which they consider GRW with any (deterministic or randomized) rule, even 
adversarial ones that try to slow-down the process. After reading their results 
we have noticed that in fact our proofs for upper bounding the edge cover 
time are independent of 1Z and hold for any rule as well. 

The choice of the starting vertex: In all of our results on cover time the bounds 
are independent of the starting vertex. Also, in most cases the considered 
graphs are vertex-transitive, and so, specification of the starting vertex is 
unnecessary. 
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1.2 Notation 



We use the standard notations of asymptotic growth rates. For two functions 
f,g : N — > R+ we write / = 0(g), when there is a positive constant C 6 R such 
that f(n) < Cg(n) for all sufficiently large values of n. The notation / = £l(g) 
means there is a positive constant c > such that f(n) > cg(n) for all sufficiently 
large values of n, and / = 0(g) means both / = 0(g) and / = 0,(g). We write 
f = o(g) iflim n ^ oo gg = 0. 

2 Edge Cover Time of Finite Graphs 

In GRW the choice of the next move depends on the history of the walk with respect 
the adjacent edges of the current vertex. Hence, it seems more natural to ask about 
the edge cover time, rather than vertex cover time. We show that for some common 
families of graphs the greedy walk covers the edges asymptotically faster than the 
simple random walk. 

Let G = (V, E) be a connected undirected graph on n vertices. Denote by 
Ce(G) the edge cover time of GRW, i.e., the number of steps it takes for GRW to 
traverse all edges of G. Note that since the graph G is finite, the edge cover time 
Ce(G) is a.s. finite. 

The basic idea behind the analysis is as follows. Divide the random discrete 
time interval [0,Ce(G)] in two (random) parts: 

1. The greedy part: all times in which the walker is at a vertex, that has an 
adjacent edge, yet to be covered, i.e., all times t G [0,Ce(G)] such that 
{X t ,X t+1 }<£H t . 

2. The simple part: all times in which the walker is positioned at a vertex all 
of whose adjacent edges have already been covered previously, i.e., all times 
t G [0,Ce(G)] such that {X t ,X t +i} G H t . In these times the choice of the 
next move has the same distribution as the one of a simple random walk. 

Roughly speaking, the GRW typically looks as follows. It starts at to = in a 
greedy time part. This time part lasts until reaching at time s\ a vertex v\ whose 
all adjacent edges have already been covered. We say in this situation that the 
walk got stuck. This means that the last step before getting stuck covered the last 
edge touching v\. Since at time s\ all edges touching v\ have already been covered, 
the walker picks an edge at random among these edges. In other words the walk 
is now in a simple time part, started at time s\. This time part lasts until the 
walker reaches at time t\ a vertex u\, that has an adjacent edge which has not 
been covered yet. By definition, the next step will belong to a greedy part, and will 
continue until reaching at time S2 some vertex V2, whose all adjacent edges have 
already been covered, thus starting the second simple part. The walk continues in 
this way until all edges are covered, and then becomes a simple random walk. 

Formally, define the times to, s±,ti, S2, t<i, ■ ■ ■ , s n recursively, where the intervals 
[U-i, Si) denote the ith greedy part, and the intervals [sj,ij) denote the ith simple 
part of the walk. 

to = 0, 

(M{ti < t < C E (G) : J t (X t ) = 0} if there is such t 
1+1 \Ce(G) otherwise , 
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t __ I inf{s i+ i < t < C E {G) : J t {X t ) ^ 0} if there is such t 
\Ce(G) otherwise. 

We say the walk got stuck at time t if t = Sj for some i £ N. It should be 
clear from the description, that the vertices X Si must all be distinct, as X Si is the 
ith time that the walk got stuck, and it is impossible to get stuck in the same 
vertex twice. Therefore, it is enough to define the times and s, only for i < n 
(where n denotes the number of vertices in G). This gives a random partition 
(0 = to < si < t\ < S2 < *2 < • • • < ifc-i < Sfc = tk = ■ ■ ■ = s n = Ce{G)) of the 
time segment [0,C E (G)], where the random variable k < n is the first i for which 
S{ = Ce{G), i.e., all edges of G are covered. 

Note that the total time the walker spends in the greedy parts equals to the 
number of edges \E\, implying the following expression on the edge cover time. 

n 

C E (G) = \E\ + Y J {U-s i ). 

i=i 

By linearity of expectation we have the following simple expression for the expected 
edge cover time, which will be the key formula in our proofs. 

Proposition 2.1 (Key formula). Let G = (V,E) be a graph with n vertices, and 
let to, s\,ti, S2,t2, ... be random times as above. Then, the expected edge cover time 
of GRW on G is 

n 

E[C E (Cf)] = \E\+Y t ^[U-8 i ]. (3) 

i=i 

Thus, in order to bound K[C E (G)}, it is enough to bound the expected total 
size of all simple parts, i.e., E[]T^ =1 (ij — Si)]. In order to apply Proposition 12. 1\ the 
following notation will be convenient. For i = 1, . . . , n let 

Bi = {v£V: J s » = 0}, 

be the set of vertices, all of whose adjacent edges are covered by time s, (B stands 
for "bad"; if the walker is in some vertex in B, then the next step will be along an 
edge that has already been crossed, thus increasing the edge cover time). By the 
definition of Sj and ij, we note that Bi = {v € V : Jt(v) = 0} for every t G [sj,ij]. 
Note also that B{ C Bj for all i < j, and the vertex Vj = X s . in which the walker 
got stick at time Sj does not belong to Bi for i < j, as at any time t < Sj the vertex 
Vj still had an adjacent edge which has not been covered yet. Thus the containment 
Bi ^ Bj is strict for all i < j < k i.e., the sets Bi form a strictly increasing chain 
until it stabilizes at B^ = V: 

Bi C B 2 C . . . C Bk = B k+1 = ... = B n = V. (4) 

In particular, 

\Bi\ < n if and only if i < k. (5) 

Conditioned on Bi and X Si , the length of the time segment [sj,tj] is distributed 
as the escape time of a simple random walk from Bi, when started at X Si . That is, 
conditioned on Bi and X Si , the random variable (t{ — Sj) has the same distribution 
as T(X Si ,Bi), where 

T(v, B) = min{t : Y t <£ B\Y = v}, 



5 



and Yq, Yy, . . . is a simple random walk on G started at Yq = v. By applying known 
bounds of the expected escape time of SRW we shall use Proposition 12.11 to upper 
bound the expected edge cover time of GRW. 



2.1 The Complete Graph 

We prove in this section that for the complete graph with n vertices the expected 
edge cover time is (1 + o(l))(2)- Specifically, we prove the following result. 

Theorem 2.2. For any rule 1Z the expected edge cover time of GRW on K n is 
bounded by 

E[C E (K n )] < \E\ + (1 + o(l))nlogn. 

This is an improvement over the 0(n 2 logn) time of the SRW, which follows by 
using the coupon collector argument. 

Proof. Consider the complete n- vertex graph G = K n . The proof relies on the 
following simple observation. For any set of vertices B C V, the escape time 
of SRW from B depends only on the size of B, and has geometric distribution. 
Specifically, for each i = 1, . . . , n, the quantity ij— Si conditioned on Bi is distributed 
geometrically: 

I otherwise. 
Denote by Tj the expected escape time from the subset B{. Then, 



n-1 



if \BA < n 



T t = nU-s l \B l ) = { n - m ( 7 ) 
otherwise. 



By averaging over B^s, the quantity Y17=i — s «] ^ s e Q ua l t° 

n n n 

5^E[t i -« i ]=5^E[E(t i -a i |S i )]=^E[r i ]=E 



i=l i=l i=l 



k-1 1 

En — 1 
n - \Bi 
i=i 



where the last equality follows from linearity of expectation, together with ([7|). In 
order to bound the sum in the expectation, let bi = \Bi\, and note that we have 
an increasing sequence of natural numbers b\ < 62 < • • • < &fc so that b\ > 1 and 
bk = n for some k < n. For any such sequence it holds that 

k—l j n— 1 ^ 

^ n - bi ~ ^ n - i ' ^ 

i=i i=i 

To see this note that all summands are positive, and each one on the left hand side 
of the inequality, appears also on the right hand side. Therefore, we can upper 
bound the quantity Ya=i ^fti — Si] by 

n n—1 ^ 

V E[ti - Si ] < V 7 = (1 + o(l))n log n 
n — 1 

i=l i=l 

Applying Proposition 12.11 gives the desired result. □ 
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Remark 2.3. We conjecture that if the rule in the greedy part is IZrand (in which 
an edge is chosen uniformly at random among the adjacent unvisited edges of the 
current vertex), then for odd values ofn, i.e., when the degree is even, the overhead 
for clique is 0(n), i.e., K[Ce(K u )] < \E\ + 0(n). For a related discussion see 
Section [^} 

2.2 Expander graphs 

We apply the same method as in the previous section on expander graphs. Let 
G = (V,E) be a (i-regular graph on n vertices and let A = A(G) G {0, l} v/xy be 
its normalized adjacency matrix, namely 



It is a standard fact that A has real eigenvalues, all lying in the interval [—1,1]. 
Denote the eigenvalues by 1 = Ai > A2 > • • • > A n > —1, and let \(G) be the 
spectral radius of G, defined as 



We say a (i-regular graph G is a (n, d, A)-expander, if A(G) < A < 1 (for more 
details see the excellent survey [15]). 

We are able to show that for d = f2(logn), the expected edge cover time of the 
GRW is linear in the number of edges. This is faster than a simple random walk, 
which covers the edges in r^dE 1 ) log \E\) steps, as mentioned in the introduction. 
Specifically, we prove the following theorem. 

Theorem 2.4. Let G be a (n,d, A)- expander graph. Then, for any rule 1Z the 
expected edge cover time is 



In particular, for an expander with d = $7(logn) the expected edge cover time of the 
GRW is linear in the number of edges. 

Proof. The key observation here is that, as in the case of the complete graph, 
E(tj— Si\Bi) can be bounded in terms of the size of Bi, independently of its structure. 
We use the following lemma of Broder and Karlin. 

Lemma 2.5 ([HJ Lemma 3]). Let G be an (n,d, A)- expander and let S $ V be a 
non-empty set of vertices. Consider a simple random walk Yq, Y\ . . . on G, starting 
at some v E S (i.e., Yq = v). Let T(v,S) be the escape time of the walk from S 
when started from v. Then 



Denoting by Tj the expected escape time from the subset Bi, by Lemma [2. 5 \ for 
all i = 1, . . . , n we have 




(u,v) € E 
(u,v)£E. 



\(G) = max [Aj 



i=2,...,n 





Ti :=E(ti -Si\Bi) < 




T?A ( lo g n + 



n-\B, 



n 



) 



if \BA <n 



(9) 



otherwise 
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for some absolute constant C € R. In order to upper bound Y17=i E[ti — s i] we a PPby 
an analysis similar to that in the proof of Theorem 12.21 Specifically, by averaging 
over the B^s, the quantity ^™ =1 E[i, — sj equals to 



J2E[U - Si ] = ^EpEfo - Si\Bi)] = J2E[Ti\ 



E 



.i=l 



i=l i=l i=l 

where the last equality follows from linearity of expectation. Using 

rfc-i 



we obtain 



5^E[ti-Si] < E 



V- C / n 



< 



c 



1 

o 



n log(n) + 



C 



A 

re log n 
1 - A 



1-A 



-E 



\Bi\ 

k-l 

£ 

,i=i 



n 



n 



where the bound 1 
same proof as 



i=i n -\B \ — 0(nlog(n)) in the last inequality follows using the 
. Using Proposition 12.11 we have 



E[C B (G)] < \E\ + E[ti - ^] = 1^1 + 



i=l 



re log n 
1-A 



which completes to proof of the theorem. 



□ 



Next, we strengthen Theorem l2.4l bv showing that for constant degree expanders 
with logarithmic girth whose vertices have even degrees, the expected edge cover 
time is linear in the number of vertices. Recall that girth of a graph G, denoted by 
girth(G) is the minimal length of a cycle in G. This result is claimed in |9j without 
proof. 

Theorem 2.6. Let G be a (n,d, A)- expander graph such that d £ N is even, and 
girth(G) = g. Then, for any rule 1Z the expected edge cover time is 



nC E (G)] <\E\+0[\E 



log(n) 

In particular, if G = (V, E) is an expander of constant even degree with girth(G) = 
fi(log(n)), then the expected edge cover time of the GRW is linear in the number of 
vertices. 

The proof relies on following simple observation. Suppose that the ith greedy 
part starts at some vertex v = X Si . Then, using the fact that all degrees of G are 
even, we conclude that this greedy part will end at the same vertex v. Indeed, by 
an Euler-path type argument if a vertex has even degree and the walker entered 
this vertex along a new edge that has not been visited so far, then by parity there 
must be another unvisited edge for the walker to leave the vertex. In particular, 
the range covered by each greedy part forms a (not necessarily simple) cycle. We 
summarize this observation below: 



Observation 2.7. If the all degrees of a graph G = (V,E) are even, then in each 
greedy time part [ii,Sj+i] it holds that X ti = X Si+1 , i.e., every greedy part ends at 
the same vertex it has started from. 

Therefore, since at the greedy time parts the walker crosses no edge twice, in 
each greedy part [tj,s$+i] the walker traverses along some (not necessarily simple) 
cycle, and thus the number of steps in each greedy time part is at least girth(G) . 



We now turn to the proof of Theorem 12.6 



Proof. Using the proof of Theorem 
bounded by 



the expected edge cover time can be upper 



(10) 



By Observation 12.71 it follows that the random number k of greedy parts is upper 
bounded by Therefore, the term log(n)E[&] is bounded from above by i2g(Mjj _ 
In order to bound the terms — ¥51 note that for all i < k, it holds that k < 



n-\Bi 



I + 



d-{n-\Bj\) 



Indeed, if in time the number of vertices all of whose adjacent 



edges have already been covered is \B{\, then the number of edges that have not 
been traversed so far is at most d ■ (n — \Bi\), and hence, by the assumption on the 
girth of G, the number of remaining greedy parts is at most d '( n ~\ B '\) _ Therefore, 
for alH < k we have 



n 



n 



\Bi 



< 



dn 



\E\ 



By (|T0|) we have 



nc E (G)] 



\E\+0 



1 



1 - A 



(k-i) ■ g (k-i) ■ g 



E[Hog(n)] + 



1 - A 



E 

\i=l 



n 



n - \Bi 



= \E\+0\\E\- 
< \E\ + o( \E\ ■ 



log(n) 
(l - X)g 

(1 - X)g 



O 



1-A 



fk-\ 



E 



\E\ 



J x {k-i)-g 



where the last inequality uses the assumption that k < n and the facts that 

□ 



Si=i API — l°g(^)- Theorem 12.61 follows. 

We show below that the assumption that graph has logarithmic girth in Theo- 
rem [212] is necessary. Specifically, we present a 6-regular expander graph graph G, 
and a rule 1Z, such that GRW with the rule 1Z coves all the edges of G in expected 
time 0(nlog(n)). In fact, the graph G satisfies an additional property, that every 
vertex of G is contained in some induced cycle of logarithmic length. This should 
be compared with the result of Berenbrink et al. [9] who have shown that if G is 
an even degree expander such that every vertex of G is contained in some induced 
cycle of logarithmic length, then the expected vertex cover time by GRW is linear 
for any rule 1Z. This shows a gap between the edge cover time and the vertex cover 
time of GRW. 
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Theorem 2.8. For every n = (mod 3) there exists a 6-regular expander graph 
G = iV,E) with \V\ = n vertices such that every vertex of G is contained in an 
induced cycle of logarithmic length, and there exists a rule 1Z such that the expected 
edge cover time of G by GRW with the rule 1Z is 0(nlog(n)). 

Proof. Let H = {U,F) be a 4-regular expander graph on n/3 vertices such that 
every vertex of G is contained in an induced cycle of length elog(n) for some 
constant e > 00 Define a graph G = (V, E) to be the cartesian product of H with 
the graph K3. Namely, the vertices of G are V = Ux{l, 2, 3} and ((it, i), (u' G E 
if and only if either (1) (n,n') G F and i = j, or (2) u = v! and i 7^ j. By the 
properties of H, the graph G is a 6 regular expander and it satisfies the property 
that every vertex of G is contained in some induced cycle of length at least e log(n). 

The vertices of G are naturally partitioned into 3 subsets V = V\ U V2 U V3 where 
Vi = {{U,i) : n G U} for i = 1,2,3. The rule 1Z is defined so that the first greedy 
part will cover all edges of the form ((it, i)(v, i)) for all (u,v) G F and i G {1,2,3}. 
Assume now that GRW starts from some arbitrary vertex (no, 1) G V\. The walker 
walks along some Eulerian cycle on V\, thus, covering all edges induced by V\. 
Indeed, this can be done, as the graph induced by V\ is isomorphic to H, and hence 
its vertices have even degrees. After completing the cycle in V\, and returning to 
the initial vertex (no, 1), the walker moves to (no, 2), performs a walk along some 
Eulerian cycle on Vj>, and returns back to (no, 2). Similarly, the walker, then, moves 
to (no, 3), covers all edges induced by V3, and returns to (no, 3). Finally, the walker 
moves back to (no, 1), and gets stuck for the first time. Note that at this point all 
edges induces by each of V^'s have already been covered by GRW, and the remaining 
edges form disjoint triangles of the form {(n, 1), (n, 2), (n, 3)} induced by each of 
the vertices n G U \ {no}. Hence, each subsequent greedy part will consist of 3 
steps, covering one triangle at each part, and the order is defined by the first time 
that SRW will reach some vertex of a triangle {(u,i) : i = 1,2,3}. Noting that 
SRW on G induces a lazy-SRW on H (where a lazy step in H corresponds to a step 
from (u,i) to (n,j) in G), it follows that in order to cover all triangles, lazy-SRW 
needs to cover all the vertices of a copy of H. Since by the theorem of Fiege |13j 
the expected vertex cover time of every graph by SRW is at least 0(nlog(n), this 
bound also holds for the edge cover time of G. This completes the proof of the 
theorem. □ 

2.3 Hypercube {0, l} d 

The hypercube graph G = (V,E) is a graph, whose vertices are V = {0, l} d and 
(u,v) G E if and only if d(u,v) = 1, where d(-, •) is the Hamming distance between 
two strings. We show that for even dimension d the edge cover time of the hypercube 
is linear in the number of edges. 

Proposition 2.9. Let d G N be even, and let Qd = (V, E) be the d-dimensional 
hypercube graph. Then, for any rule 1Z the expected edge cover time ofQd is bounded 
by 

nC E (Q d )] = 0(\E\). 

Proof. The proposition follows from the following lemma. 

1 Such graph can be obtained by choosing a random 4-regular graph. For reference see [101 Chapter 
II.4]. 
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Lemma 2.10. Let G = (V, E) be a graph whose vertices have even degrees. Suppose 
that for the graph G the expected vertex cover time of SRW is C. Then, the expected 
edge cover time of GRW of G is at most 

E[C E (G)] < \E\ + C. 

Since the number of edges in Qd is \E\ = |d • 2 d , and using the fact that the ex- 
pected vertex cover time of the hypercube by SRW is C = 0(d-2 d ), Proposition 12.91 
follows by Lemma 12.101 □ 

We now turn to the proof of Lemma 12.101 

Proof (of Lemma \2.10\) . The proof proceeds by coupling between a SRW and a 
GRW so that the number of steps made by the GRW is larger than the number of 
steps made by SRW by at most \E\. 

As observed above, in Observation 12. 71 for graphs of even degrees we have X^ = 
X Si+1 for all i <k, i.e., every greedy part finishes at the same vertex that it started 
from. This implies that the simple parts can be concatenated, as the end of the ith 
simple part is X ti , and the beginning of the (i + l)th part is X s . +1 . The coupling 
between the SRW and the GRW is the natural one, where the SRW performs all 
the steps that the GRW makes in its simple parts. Clearly, the number of steps 
made by the GRW is larger than the number of steps made by SRW by at most 
the total number of steps made in the greedy parts, which is bounded by 

Observe that whenever the SRW reaches some vertex v, it is either the case that 
(1) all edges adjacent to v have already been covered by GRW, or (2) the vertex v 
is the last vertex in the current simple part, and thus, using the property X ti = X Si 
for all i, the next greedy part will cover all edges adjacent to v. This implies that 
by the time the SRW covers all vertices of G, the GRW has either already covered 
all edges of G, or will do so in the number greedy part. Therefore, the edge cover 
time of GRW is larger than the vertex cover time of SRW by at most \E\. This 
completes the proof of the lemma. □ 

We also remark (without a proof) on the edge cover time of a generalization of 
the hypercube graph. 

Remark 2.11. Define a generalization of the hypercube by connecting two vertices 
in {0, l} d if the distance between them is at most some parameter £ > 2. Specifically, 
for £>2, let H { d ~ e) = (V,E e ), where V = {0,l} d and (x,y) G E iff d{x,y) < £. 

Denoting the number of vertices in the graph by n = 2 d , the spectral radius of H^~^ 
is bounded from above by A < 1 — . Therefore, by Theorem \2.4\ for £ > 2 the 

expected edge cover time of GRW on fll is |£^| + 0(nlog 2 n), where the constant 
in the 0() notation depends on i. 

Noting that the number of edges in Hj is \E(\ = 0(n- log e n), this implies that 
for £ = 2 the edge cover time is linear in the number of edges \E2\ = 0(n ■ log 2 ra), 
and for £ > 3 the edge cover time is (1 + o(l)|£^|. 

2.4 d-regular trees 

In this section we provide an upper bound for the edge cover time of GRW on trees. 
We are able to describe the behavior of GRW quite accurately, and subsequently 
provide a tight bound on the cover time. 
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Theorem 2.12. Let G = (V,E) be a tree rooted at a vertex denoted by r, such that 
deg(r) > 2. For any v G V denote by T v the subtree rooted at v and let \T V \ denote 
the number of edges in T v . Then, for any rule 1Z the GRW edge cover time of G is 

E[C E (G)] = \E\ + O I Y l T «l)- 

\«eG\{r} / 

If the rule for GRW is TZrand, then there is a matching lower bound, namely 

E[C E (G)] = \E\ + e j Y l T «ll- 

\«eG\{r} / 

The following corollary in immediate from Theorem I2.12I 

Corollary 2.13. If G is a d-regular tree with n vertices, then the expected edge 
cover time is 0(nlog d n). 

Comparing Corollary 12. 131 to the cover time of SRW on (f-regular trees, we again 
see an asymptotic speed-up over the 0(nlog^n) time of the SRW [2]. 

Proof. In order to use the tree structure of the graph, let us first give an overview 
of the behavior of GRW on trees. The walker starts at the root r and goes down 
greedily (i.e., an unvisited edge is traversed in every new step), until reaching a 
leaf. Since it got stuck at a leaf, it performs a simple random walk until reaching 
its lowest ancestor with an adjacent edge that has not been covered yet. The non- 
covered edge is necessarily from the ancestor to one of its children, (as its parent 
has been already visited on the way down). The walker continues by moving down 
greedily until reaching another leaf not covered thus far, and then performs an SRW 
until reaching again its lowest ancestor with a child that has not been visited thus 
far by the walk. The walk continues in the same manner until covering all edges, 
getting stuck only at the leaves. In fact the walk gets stuck exactly once in each 
leaf, and the time Ce(G) is the time when walker visits the last leaf of the tree. 
Note that when visiting some vertex v, the walk will cover the entire subtree of v 
before returning to v 's parent. This property is what makes the cover time of GRW 
asymptotically faster than the cover time of SRW. 

The order in which the vertices are visited for the first time defines some preorder 
traversal on the tree (first the root, then the subtrees), where for each vertex the 
order of the subtrees is chosen according to the rule 1Z. We observe that the 
vertices (X S1 , X S2 , . . . , X Sk ) define some order on the leaves of the tree, induced by 
the preorder traversal as described above (and in particular, k equals to the number 
of leaves). In addition, for every % < k, the vertex is the lowest ancestor of X Si 
such that at time Sj not all of its descendants have been visited by the walk. Hence, 
E[ti — Si] equals the expected time it takes for the simple random walk starting at 
X Si to visit this ancestor. This implies that for every edge (u,v), where u is the 
parent of v, there is at most one i G {1, . . . , k} such that the edge (u, v) lies on the 
shortest path from X Si to X^ . Therefore, if w is the leaf where the walk got stuck 
for the zth time, that is, X Si = w, and v is its lowest ancestor whose subtree is not 
covered yet, then the expected time to reach v staring from w is 

E[U - Si ] = H(w, v)= Y H (ui,u 2 ), 

(ui,« 2 )GP( IU ,„) 
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where H (x, y) denotes the expected number of steps required for SRW starting at 
x to visit y, and the sum is over all edges on the shorted path from w to v (using 
the convention that the edge (ui,?^) means that 112 is a parent of u\. 

Going over all leaves in in the graph, and using the observation that the walk 
gets stuck in each leaf exactly once (stopping at the last visited leaf at time s^), 
and finishing the corresponding simple part at the lowest ancestor whose tree has 
not been covered yet, we observe that for each i < k the shortest paths from X Si to 
Xt t are disjoint. Furthermore, the union of all these paths covers all edges of the 
graph except for the path from the last covered leaf, denoted by / = X Sk , to the 
root of the tree. Let us denote by P( r ,i) be the shortest path from / to r. Then 



E 



E 



£ H(u,v) 

(u,v)£E\P (rtl) 



< 



(u,v)£E 



H(u,v) 



where H(v, u) denotes the expected number of steps, required for SRW starting at 
v to visit u for the first time, and the summation is over all edges (u, v ), where v is 
the parent of u. 

It is well known (see e.g., Lemma 1]) that if (u, v) is an edge in a tree, then 

H(u,v) = 2|T U | + 1 < 3|T U |. 

Proposition 12. II together with (jlip . proves the upper bound of the theorem. 

If GRW uses the rule 7£rand> then the subtrees rooted at the children of r are 
explored completely one after another (the order of the children is random), and 
the walk will return to r from all but the last subtree. Therefore, for each u child of 
r the subtree rooted at u is completely explored by GRW with probability , 

and hence, every edge of the tree belongs to P[ r j) with probability at most 
Therefore, by applying the formula in (jlip we get 



1 

deg(r) ' 



E 



£(*t - Si) 



i=l 



E 



> 



> 



£ H(u,v 
(u,v)eE\p {rA 

deg(r) ^ 



u,v) 



d6g(r) niCM 



This completes the proof of the theorem. 



□ 



3 Greedy Random Walk on Z 

In this section we study the behavior of GRW on infinite graphs. Specifically we 
ask whether the walk is recurrent or transient in different graphs. Obviously, on Z 
GRW visits every vertex at most once. We show that for d > 3 the greedy random 
walk on Z d is transient. 

Theorem 3.1. Let G = (V,E) be an infinite graph, where all its vertices are of 
even degree. If the simple random walk on G is transient, then for any rule 1Z the 
greedy random walk is also transient. 
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In particular for d > 3, the greedy random walk on Z returns to the origin only 
finitely many times almost surely. 

Proof. Partition the time [0, +00] into two types of parts, greedy parts and simple 
parts, by denning times to = 0, s\, t\, S2>i2> • • • £ N U {+00} as follows: 



(Analogous partition underlies the results in Section [2j The difference here is that 
the times can have the value +00.) 

For the reader's convenience we restate Observation 12.71 adapted for the case of 
infinite graphs. 

Observation 3.2. If all degrees of a graph G = (V, E) are even and Sj + i < 00, 
then Xf. = X..,, . 

Assume that the event that Sj or ti equals +00 for some i > 1 and i& is the first 
such time has a positive probability. Conditioning on this event, the walk remains 
in a simple part starting from time s&, and hence performs a simple random walk 
from this time onwards. Since SRW is transient on G, the walk will return to Xq 
only finitely many times a.s.. Actually, since the random range R = {Xt : < Sk} 
is finite, and the SRW is transient, conditioning on R, the SRW will leave R in 
finite time a.s., and so is a.s. finite, contradicting the assumption. 

Similarly, if the event that s, or t$ equals +00 for some i > 1 and s^ is the first 
such time has a positive probability, then, conditioning on this event, the walk is 
in a greedy part from t^—i onwards. In other words, from time tk-i onwards the 
walker crosses each edge at most once. Hence, as the degree of Xq is finite, the 
maximal number of returns to Xq is at most deg ^"°) ^yi, and in particular a.s. 



Assume now that the event that Sj,tj < +00 for all * > 1 has a positive prob- 
ability, and condition on this event. Using the assumption that all vertices of the 
graph have even degrees it follows from Observation 13.21 that Xf t = X Si+1 for all 
i > 0. Therefore, for all i > the walk in time segments [sj,tt] and [sj+i, ii+i] can 
be concatenated. Hence, the walk restricted to time Ui>o[ s *'^] ^ s distributed as a 
SRW on G, and so, by transience, returns to Xq finitely many times almost surely. 
Since in the overall greedy parts the walker can visit Xq at most dcg ^ y °) times, the 
entire walk returns to Xq finitely many times a.s. □ 

Note that we strongly used the fact that all vertices in our graph have even 
degree. The following proposition shows a similar result by slightly relaxing this 
assumption. 

Proposition 3.3. Let G = (V, E) be a graph obtained from Z 3 by removing at most 
r 1 ~ e edges from any box of radius r around the origin for some e > 0. Then the 
greedy random walk on G is transient. 



to = 





otherwise. 



if there is such t 



finite. 



14 



The proof generalizes the concatenation argument of Theorem 13.11 Unlike the 
previous proof, which relied on the fact that all vertices had even degrees, in our case 
some vertices have odd degrees. Hence it is possible that the simple parts cannot be 
concatenated into one walk. However, we can divide the simple parts into classes, 
such that in each class the parts can be concatenated into one simple random walk. 
The proof uses the fact that if there are r 1_e independent simple random walkers 
started at a box of radius r around the origin, then the total number of visits at 
the origin by all the walkers is almost surely finite. 

Proof. We start with a time partition (to = 0, 8\,t\, S2, t%, . . . ) as in the proof of 
Theorem 13.11 Call a vertex v a new start if v = X Si for some i and Xt- ^ v for 
all j < i. As in the proof of Theorem 13. 1\ the concatenation argument implies that 
every new start vertex must be either the origin or have an odd degree. 

Consider the walk restricted to the segments [sj,ij]. The indices i > 1 can be 
partitioned into classes C\,C%, ■ ■ ■ such that in each class Cj the segments [sj,ij], 
i G Cj, can be concatenated into one walk that starts with a new start vertex. 
Namely, if Cj = {i% < i% < 23 < ■ ■ ■ }, then X Si is a new start and X Si ^ = 
Xt^ , X Sis = Xf i2 , . . . Denoting by rrij = min Cj we have X Sm _ is necessarily a new 
start, and therefore is either the origin or a vertex of odd degree. Moreover the 
times {s mj }j are all distinct. 

For each Cj, restricting the walk to times (J{[ s «^i] : i £ Cj} gives us a simple 
random walk (possibly finite) starting from X Sm , . Therefore there are at most 

0(r 1_e ) simple random walks, starting from a box of radius r around the origin. 
Using the fact that a random walk in Z 3 starting from a vertex at distance r from 
the origin hits it with probability 0(l/r), we conclude that the sum of probabilities 
of hitting zero converges, when summing over all random walks. More precisely, let 
P v be the probability that a SRW starting at v reaches the origin, and let ODD be 
the set of all vertices of odd degree. Then 

E ^ = E E p v z E^) 1 " ■ °(^) 

veODD n=l v&ODD n 

2 n ~ 1 <\\v\\<2 n 

Therefore, by the first Borel-Cantelli lemma, a.s. only finitely many of the walks 
will reach the origin, implying that the GRW on this graph is transient. □ 

As a last application of the concatenation argument, we show that for any 
vertex-transitive graph with even degrees the expected number of edges covered by 
the GRW in t steps cannot be asymptotically smaller than that of the SRW. 

Proposition 3.4. Let G = (V, E) be a vertex-transitive graph with vertices of even 
degree. Denote by Nw(t) the expected number of edges covered by the walk W in t 
steps. Then M G Rw{t) > \ -NsRw(t). 

Note that by vertex transitivity, Mwif) 1S independent of the initial vertex. 

Proof. Let S be the random variable denoting the number of steps that GRW spent 
in the simple parts up to time t, and let (t — S) to be the number of steps spent in 
the greedy parts. Denote by McRw(t\ s ) t ne expected number of edges covered by 
GRW conditioned on the event S = s. Using the fact that all vertices of G have 
even degrees for every s < t we have A/grw(^|s) > max(t — s,A/"srw(s))- Indeed, 



CCr) 
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t — s is the number of steps in the greedy part, and therefore A/grw(*|s) > t — s. 
The inequality A/grw(*|s) > A/srw(s) follows by coupling using the concatenation 
argument as in the proof of Theorem 13.11 

If s < t/2, then A/grw(*|s) > t/2 > A/*srw(*/ 2 )- Otherwise, we have A/grw(*N) - 
A/srw(s) > A/srw(*/ 2 )- Note that -A/srw(*) < 2 • W S rw(V 2 )> which holds by the 
Markov property of SRW on a vertex-transitive graph. Averaging over S we get 

A/grwW = E[A/- GRW (t|S)] > i^sRw(t)- □ 
3.1 Z 2 and the mirror model 

The following observation relating the behavior of GRW on Z 2 to the mirror model 
is due to Omer Angel. 

In the mirror model, introduced by Ruijgrok and Cohen [18] a mirror is placed 
randomly on Z 2 by aligning a mirror along either one of the diagonal directions 
with probability 1/3 each, or placing no mirror with probability 1/3. A particle 
moves along the edges of the lattice and is reflected by the mirrors according to the 
law of reflection. See, e.g., [12] for details. A major open problem in this area is to 
determine whether every orbit is periodic almost surely. We claim below that this 
question is equivalent to determining whether GRW with rule T^rand is recurrent 
in Z 2 . (Recall, in the rule 7£rand an edge is chosen uniformly at random among 
the adjacent unvisited edges of the current vertex). 

Let (Xt)t>o be GRW on Z 2 with the rule 7£rand- Then, there exists a coupling 
between (Xt)t>o and the particle motion in the planar mirror model until the first 
time they return to the origin. Indeed, if at time t > GRW reaches a vertex Xt 
that we have not visited so far, then in both GRW and in the mirror model the 
next step will be chosen in a non-backtracking manner, giving equal probabilities 
of 1/3 to each of the adjacent vertices (except for Xt-\). In the mirror model this 
uniquely defines the alignment of the mirror at vertex Xt, and hence the next move 
of the particle in the next visit to this place, given that the orbit is not periodic: 
it will go to the unvisited neighboring vertex. On the other hand, if at time t > 
we reach a vertex Xt that has already been visited previously, then the next step 
is uniquely determined: it is to make a move along the edge that has not been 
traversed so far. This defines a coupling of the two models up to the first returning 
time to zero. 

Claim 3.5. The probability that GRW with the rule TZrand on ^ 2 returns to the 
origin at least once is equal to the probability that a particle returns to origin in the 
planar mirror model. 

From Claim [331 we infer the following theorem. 

Theorem 3.6. GRW with rule TZrand on Z 2 returns to the origin infinitely often 
almost surely if and only if the orbit in the mirror model on Z 2 is periodic almost 
surely. 

Proof. Note first that GRW on Z 2 returns to the origin infinitely often if and only if 
every greedy part is finite. Indeed, if there is an infinite greedy part, then there are 
finitely many returns to the origin as every vertex is visited at most twice in total 
in all greedy time parts. In the other direction, assume that all greedy time parts 
are finite. Then, by the concatenation argument, which follows by O b ser vat ion 13.21 
the simple parts form an infinite subsequence distributed as SRW on Z 2 starting 
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at the origin. The latter returns to the origin infinitely often almost surely, and 
hence, so does GRW. Therefore, it is enough to show that the orbit in the mirror 
model on Z 2 is periodic a.s. if and only if every greedy part is finite. 

Suppose first that every orbit in the mirror model on Z 2 is periodic almost 
surely, and suppose that GRW starts the ith greedy part at some time ij. Then, 
condition on the ij steps of GRW so far, defines the orientation of the mirrors in the 
vertices visited up till now. Since, the number of visited vertices is finite, it follows 
that the conditioning is on a non-zero event, and so the trajectory of the particle 
starting from Xt- is a.s. periodic. Therefore, by considering the coupling between 
GRW and the mirror model conditioned on that event, analogously to Claim 13.51 
it follows that with probability 1 the ith greedy part is finite. 

Assume now that every greedy part of GRW is finite. Note that by translation 
invariance it is enough to show that trajectory of a single particle starting at the 
origin is periodic almost surelyJl Indeed, since GRW returns to the origin twice a.s., 
it follows from the coupling in Claim [331 that the trajectory of a particle starting 
at the origin is periodic almost surely, as required. □ 



4 Remarks and Open Problems 



4.1 Conjecture Regarding Theorem 12.2 



Observation 12.71 used in the proof of Theorem 12.61 seems to be potentially useful for 
proving stronger bounds on the edge cover time of GRW. 

Observation 4.1. If the all degrees of a graph G = (V,E) are even, then in each 
greedy time part [fj,Sj+i] it holds that X^ = X Si+1 , i.e., every greedy part ends at 
the same vertex that it started from. 

To illustrate how this observation can be useful, let us consider the GRW on the 
complete graph K n . In the argument we only used the assumption that the "bad" 
sets Bi grow at least by one each time, thus allowing us to bound the "overhead" 
by E Yli=i n-jk- — ^ Sti 7^7 — n log( n )- We suspect, however, that in fact 
the sets Bi grow linearly in n, as by the time the walker gets stuck for the first time, 
i.e., visits the starting vertex n/2 times, we expect that the number of vertices that 
have already been visited n/2 times is linear in n. The situation, however, becomes 
more complicated when trying to analyze the set B2, as it seems to require some 
understanding regarding the subgraph of K n that has not been covered by the time 
s\ , when the walker got stuck for the first time. If this is indeed true, and the sets Bi 
grow linearly in each step, we would obtain a stronger bound E[^(ij — si)\ = O(n). 
We make the following, rather bold, conjecture. 

Conjecture 4.2. The expected edge cover time of GRW on K n is 

E[C E (K n )} = \E\ + G(n). 



2 Indeed, if trajectory of a particle starting at the origin is periodic almost surely, then, by translation 
invariance the trajectory of a particle starting at any vertex and moving in any direction is periodic 
almost surely. Thus, by placing, 4 particles at each vertex of the graph, and letting them move in the 
4 possible directions, it follows that with probability 1 the trajectory of each of them a periodic, as this 
this event is an intersection of countably many probability 1 events. Therefore, trajectory of a particle 
is periodic almost surely if and only if all orbits are periodic almost surely. 
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An interesting result in this direction is a recent result of Omer Angel and Yariv 
Yaari. They showed that for the complete graph K n for odd values of n, i.e., when 
the graph K n is of even degree, the expected number of unvisited edges in K n until 
the first time the walk got stuck (i.e., up to time s\) is linear in n [19]. 

4.2 Rules on Vertices Instead of Edges 

In this paper we have considered edge cover time of graphs, rather than vertex 
cover time. This seems to be a natural quantity to analyze due to the transition 
rule of GRW. A naive modification of GRW to speed-up the vertex cover time is 
the following. At each step, the walker at vertex v picks an unvisited neighbor 
of v according to some rule and jumps there. If all neighbors have already been 
visited, the next move is chosen uniformly at random among the neighbors of v. For 
example, it is obvious that in the complete graph K n , this walk covers all vertices 
in n steps. 

Note that, when the walker is allowed to make some local computations at a 
vertex, and each vertex has the information regarding its neighbors, then one can 
define a rule that will force the walk to perform depth first search on the graph, 
by letting each vertex use only the information regarding its neighbors. Such walk 
crosses at most twice each edge of some spanning tree, thus visiting all vertices of 
the graph in less than 2n steps. 

4.3 Open Problems 

In order to avoid trivialities, in the questions below consider GRW with the rule 

7?"RAND- 

1. Given a tight bound for the "overhead" of GRW on the complete graph. 
Specifically, is it true that E[C E (K n )] = (™) + 9(n)? 

2. Show upper bounds on Ce(G) for other families of graphs. One interesting 
example to look at could be the d-dimensional torus. 

3. It seems also interesting to analyze the GRW on graphs with power-law degree 
distribution. On such graphs there are hubs of very large degrees and when 
visiting them, the GRW is expected to be efficient. 

4. Show that for any transitive graph the expected edge cover time of the GRW 
cannot be asymptotically larger than that of the SRW for any finite graph. 
By Proposition 13. 4| this is true for vertex-transitive graphs of even degree. 

5. Give bounds on the expected vertex cover time of the GRW for finite graphs. 

6. Give bounds on the expected hitting time of GRW for different graphs. 

7. Define GRW mixing time and show that GRW mixing time is as fast as that 
of SRW. Here [3] is relevant, and also |16| may be found useful. 

The remaining problems are regarding recurrence/transience of GRW on in- 
finite graphs. 

8. Is GRW on Z 2 recurrent? Is GRW diffusive on Z d , for all d > 2? 

9. Is GRW on the ladder 7L x Z2 recurrent? 
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10. Prove that GRW is transient on any graph that is roughly isometric to Z 3 . In 
particular show it for odd degree lattices. 

11. Show that GRW is transient on non-amenable infinite graphs. 

12. Consider GRW on a vertex transitive graph. Is there a zero-one law for the 
following events: 

(a) The walker returns to its initial location infinitely often. 

(b) The walker returns to its initial location at least once. 

Is it true that (a) happens almost surely if and only if (b) happens almost 
surely? 
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